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RECURSIVE INVERSION OF EXTERNALLY DEFINED LINEAR SYSTEMS 


Ralph E. Bach, Jr.,* and Yoram Baram## 


SUMMARY 


The approximate inversion of an internally unknown linear system, given by its 
impulse response sequence, by an inverse system having a finite impulse response, is 
considered. The recursive least squares procedure is shown to have an exact ini- 
tialization, based on the triangular Toepliz structure of the matrix involved. The 
proposed approach also suggests solutions to the problems of system identification 
and compensation. 


1 . INTRODUCTION 


Linear system inversion — that is, interchanging the roles of the input and 
output signals — has been of interest in systems theory and in signal analysis in the 
past (see, e.g., [1], [2]). Recently, interest in the system inversion problem has 
been motivated by problems of geophysical exploration (see, e.g., [3]). In many 
cases, the system at hand is internally unknown and may not even possess a finite- 
order representation. An external representation in the form of the impulse 
response function may be generated, in principle, by measuring the response to a 
high-energy pulse, as is done in geophysical exploration, or by calculating the 
cross-correlation function between the output and a pseudo-random input, as is done 
in control applications. While, as we show, the impulse response of the inverse 
system is well defined, its calculation becomes practically intractable for long 
data records. Instead, a finite-order approximation of the inverse system may be 
sought. Such an approximation will yield, simply by inversion, a solution to the 
problem of system identification. We show that when the approximate inverse system 
is restricted to have a finite impulse response, the design problem can be solved by 
a recursive least-squares procedure having an exact initialization. The approach is 
readily extendable to the problem of cascade compensation. 


*R. E. Bach, Jr., is with the NASA Ames Research Center, Moffett Field, CA 
94035. 

#*Y. Baram is a Senior Research Associate of the National Research Council at 
the NASA Ames Research Center, Moffett Field, CA 94035, on sabbatical leave from the 
Department of Electrical Engineering, Technion, Israel Institute of Technology, 

Haifa 32000, Israel. 
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2. EXACT INVERSION 


In order to demonstrate the need for approximation in the inversion of inter- 
nally unknown linear systems, we first consider their exact inversion. Since dis- 
crete time systems often have delayed response, it is also our purpose to define a 
unified representation for the inverses of systems with and without delays that, 
without burdening the notation, will make the results applicable to both cases. 

Let (h k ), k > 0 be the impulse response of a causal time-invariant linear 

system. We shall assume for convenience that the system is single-input, single- 
output, and real, i.e., that (h k ) is a scalar sequence. The system's output (y k ) is 

obtained from its input (u k J by the convolution operation 

k 

'r “k ' "k = Z ‘iVi ki0 (2 - n 

i=0 

It is readily verifiable that the inverse of (2.1) is given by 


u k = \ * \ k s 0 


( 2 . 2 ) 


where (h~), k > 0 satisfies the progressive equation 


with 




i 


k > 1 



(2.3) 


Next, suppose that h k = 0 for k = 0,...,i - 1, i.e., that the system has 
l time-unit delays. Then, clearly, the above inversion is ill-defined. The 
inverse system can, however, be redefined. First it should be realized that the 
inverse system no longer operates in "real time" on (y k ) but, instead, it operates 
on a record of {y k }, advanced l time-units with respect to the original 
sequence. Defining the sequences 


2 



and 


( 2 . 4 ) 
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= y k + 8 



h k+!l 


k > 0 


The system can, again, be written in "causal form" as 


4° = h l l) * \ k * 0 


which has the inverse 


u. = h, (!l) ~ * vf 1 ^ k > 0 


k k 


where {h^ }, k > 0 satisfies 


with 




h 


k-i l ’ 


k > 1 



( 2 . 5 ) 


( 2 . 6 ) 


Since the 8,-delay system now has exactly the same form as the 0-delay system, the 
index (i) can be removed with the understanding that when the system at hand has 
delays, its inverse must be interpreted as operating on y^ 11 as an input, as in 
equation (2.5). 

It can be seen that the inverse of a causal, time-invariant, linear system 
given by an infinite-length impulse response is well defined. However, the calcula- 
tion of the inverse impulse response becomes intractable, as both the memory and the 
amount of computations required grow indefinitely. Under certain conditions, dis- 
cussed in the following section, the error resulting from taking a finite portion of 
the sequence {h~} can be shown to diminish as the length of this portion is 
increased. However, this will not be, in general, an optimal choice of a finite 
impulse response approximation of the inverse system. Such approximation is the 
subject of the next section. 


3. RECURSIVE LEAST-SQUARES INVERSION 


Let (f k ), k > 0, be the impulse response of an approximate model for (h k K 
Noting that 


h k * 


h k = 


where 6 k is the unit impulse sequence (6 k = 1 for k = 0, 6 k = 0 for k > 0) an 
approximation of h“ can be obtained by minimizing some measure of the difference 
between f k * h k and 6 k with respect to f k . 

Denoting the sum-square norm of a sequence {a k }, k > 0, by 



an approximation criterion for the problem at hand is defined by 

min | | f 

Suppose that the inverse approximating model is restricted to have a finite 
impulse response of length n, that is, f k = 0 for k > n. The approximation norm 
then becomes 


* h 

k n k 


- «J| 


(3.1) 


where 



(3.2) 


and the n-dimensional vector sequence (h k ) is given by 
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h .r [h k **-> 
' k " t [ \ Vi 

The least-squares problem 



(3.3) 


m ‘ n Z ‘-k 1 ■ V 2 

- k=0 


yields the equation 

T T T f = T T b (3.4) 

OO CO — CO — CO 

where 



Let f m be defined by the equation 

T T 

T*T f = T X 

m in-in m-m 


(3.5) 


where, for m > n, 
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and 


is m-dimensional . The matrix T n can be seen to be lower triangular Toeplitz. It 
is readily verifiable (also see, e.g., [4]) that such structure yields the inverse 


where, as in (2.3) 


„-1 


0 


h , h n • • • h . 
n-1 n-2 0 


(3.6) 


h k = - h„ S h k-i h i k " 1 


0 1=1 


and 



Since h Q can be assumed to be non-zero (otherwise, ^t is replaced by 
hj 1 ’ = h £ , as explained in section 2), the matrix T” exists, yielding 


f = T _1 b 
-n n -n 


(3.7) 


For m > n, we obtain from the least-squares recursion (see, e.g., [5], p. 176) 


f . 
-m+1 


f - K h f 
-m m-tn-m 


(3.8) 


with 


K m = 


Rh 
m— m 


1 + hlR h 

— m m — m 


(3.9) 
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where R = (T T T ) 1 satisfies the recursion 
m mm 


m+1 


= R 


m 


m 


T 

hh* 
— m— tn 


T 

t^R h 

— m m— m 


m 


( 3 . 10 ) 


initialized at 


R = T 1 (T“ 1 ) T 
n n n 


(3.11) 


where T _1 is given by (3.6). We note that while it is often suggested that a 
recursive least-squares procedure be initialized at arbitrary values of R 0 and f Q 
in order to avoid matrix inversion (see, e.g., [5], p. 177), the above procedure is 
initialized at the exact values of f n and R n , specified by (3.7) and (3.11). 

The convergence of the above recursive procedure is examined next. From (3.4) 
we directly obtain the equation 


Rf = 


*0 


where h Q is defined by (3.3) and 


where 


R = 


T 

T i 
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Suppose that the system at hand is externally (bounded input/bounded output) 
stable. Then 


z 


k=0 


l h k i < 00 
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we have 


Zivwi = Z^k^Vii s ZivZi'vJ < - 

k=0 k=0 k=0 k=0_ 

yielding convergence of a i . It follows that the recursive least-squares inversion 
procedure (3-8) converges if the system is externally stable. 

The inversion error at each step of the recursive inversion procedure can be 
calculated as 


: 2 : (T f - b ) T (T f - b ) 
m m-m -m m-m -m 


which, by substituting (3-5), yields 


where f m 0 is the first component of f^. 

We next examine the behavior of the inversion error as the length (or the 
order) of the inverse system is increased to infinity. We assume that the sequence 
{h~} is bounded (in other words, the inverse system is stable). Let us define the 
sequence 

pi" k = 0, . . . ,n - 1 
p k = 1 

U> k > n 

Then, since (f k ) minimizes the inversion norm, we have 

* h k - a kl i 

yielding 

lim||f k * h k - « k || < ||h" * h k - « k || = 0 
n-® 
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hence , 


Italic * h„ - 6„|| = 0 


n->® 


In words, the inversion error diminishes to zero as the length of the inverse filter 
is increased to infinity. 

An approximate model for the system at hand can be obtained by inverting the 
resulting inverse system. Th^model will be of the all-pole type, specifically 
1 / ( f 0 + f + ... + ^ n _i z + )> where z is the z-transform variable. We note 
that is the given system has, say, I time unit delays, that is, h i =0 for 
i = 0, ...,&— 1, the resulting approximate model should be multiplied by z -1 , as the 
proposed technique, in effect, approximates the given system multiplied by z z . 

This approach yields a solution to the problem of system identification. The 
impulse response sequence may be obtained directly by applying a high-energy pulse 
at the input, or, by simple calculation, from the cross correlation between the 
output and a white noise input. 

Next, suppose that it is desired to compensate a system given by its impulse 
response sequence {h k } by cascading it with a relatively simple system so as to 
approximate a desired system whose impulse response {g k } is given or can be calcu- 
lated. When the compensator is restricted to have a finite impulse response, its 
parameters may be obtained by minimizing the norm ||f k * h k - g k ||. The recursive 
least-squares procedure (3.8) is then replaced by f . = f + K (g - h T f ) , 
with K m and h m defined by (3.9-3.11) and (3.3), respectively, finally™ we note 
that a recent paper [6] addresses the least-squares compensation, inversion, and 
approximation of internally known linear systems by polynomial systems. 


4 . CONCLUSION 


The inversion of an internally unknown linear system has been considered. A 
recursive least-squares procedure having an exact initialization, for calculating 
the parameters of a finite impulse response inverse system, has been derived. The 
proposed approach also suggests solutions to the problems of system identification 
and compensation. 
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